Lecture 3 


Basic sorting algorithms 



Array filling with random numbers 


//Example 1 
using System; 

namespace BasicSorting 

{ 

class Examplel 

{ 

static void Main() 

{ 

int[] nums = new int[10]; 

Random rnd = new Random(); 
for (int i = 0; i < 10; i++) 
nums[i]=rnd.Next(); 

DisplaylntArray(nums); 

Console. WriteLine(”Press any key to continue 
Console. Read(); 

} 

static void DisplayIntArray(int[] intArray) 

{ 

for (int i = 0; i < intArray.Length; i++) 

{ 

Console. WriteLine(" Element {0} is {1}”, 

> 

} 

> 

} 


i, intArray[i]); 



Bubble sort 
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• is one of the simplest sorts to 
understand and implement 

• Is one of the slowest sorting 
algorithms available 

• values "float like a bubble" from one 
end of the list to another 
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• The code to swap two array elements is written inline rather than as a subroutine 

• Simply, from the start of the array, compare each adjacent two numbers. If they are in the 
desired order leave them as they are. Otherwise, swamp them. 

• After each pass, there is one number that took its correct place, so there is no need to pass by 
it again. 

• Why upper ends at 1? Why inner stops at outer-1? 

• Is it descending or ascending order? How to change that? 







































































































Bubble Sort 


Simply, from the start of the array, 
compare each adjacent two 
numbers. If they are in the desired 
order leave them as they are. 
Otherwise, swamp them. 

The code to swap two array 
elements is written inline rather 
than as a subroutine 
After each pass, there is one 
number that took its correct place, 
so there is no need to pass by it 
again. 

Why outer ends at 1? Why inner 
stops at outer-1? 

Is it descending or ascending order? 
How to change that? 


// example 2 
using System; 

3 Bnamespace BasicSorting 

{ 

class Example2 

{ 

7 1 El static void Main|() 

{ 

int[] nums = new int[10]; 

Random rnd = new RandomQ; 
for (int i = 0; i < 10; i++) 
nums[i] = rnd.Next(100); 

Console. WriteLine( "The unsorrted array: ”); 

DisplaylntArray(nums); 

Console. WriteLine("The sorted array using bubble sort: ”); 
BubbleSort(nums); 

DisplaylntArray(nums); 

Console. WriteLine(”Press any key to continue:”); 

Console. Read(); 

> 

static void BubbleSort(int[] intArray) 

{ 

int temp; 

for (int outer = intArray.Length-1; outer >= 1; outer--) 

{ 

for (int inner = 0; inner < outer; inner++) 
if (intArray[inner] > intArray[inner + 1]) 

{ 

temp = intArray[inner]; 
intArray[inner] = intArray[inner + 1]; 
intArray[inner + 1] = temp; 


} 


} 


} 

static void DisplayIntArray(int[] intArray) 

{ 

for (int i = 0; i < intArray.Length; i++) 

{ 

Console. WriteLine(“Eleroent {0} is {1}’’, 

> 

> 



Selection sort 

• starting at the beginning of 
the array, comparing the 
first element with the other 
elements. If a smaller one 
found, swap it with the first 
location 

• the sort then begins again 
at position 2 

• This continues until each 
position, except the last 
position, has been the 
starting point for a new loop 
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Selection Sort 


The outer loop moves from the 
first element in the array to the 
last element 

The inner loop moves from the 
outer +1 element of the array to 
the last element, looking for value 
that are smaller than the element 
currently being pointed at by the 
outer loop 

After each iteration of the inner 
loop, the most minimum value in 
the reset of the array is assigned 
to its proper place in the array 
Is it descending or ascending 
order? How to change that? 


2 

using System; 

3 Bnamespace BasicSorting 

5 E 

] class Example3 

r 

j|E 

\ 

static void Main|() 

9 

int[] nums = new int[10]j 

10 

Random rnd = new Random(); 

11 

for (int i = 0; i < 10; i++) 

12 

nums[i] = rnd.Next(100); 

13 

Console. WriteLine("The unsorrted array: ”); 

14 

DisplaylntArray(nums); 

15 

Console. WriteLine ("The sorted array using bubble sort: “); 

16 

SelectionSort(nums); 

17 

DisplaylntArray(nums); 

18 

Console. WriteLine(”Press any key to continue:”); 

19 

Console. Read(); 

20 

} 

21 F 

static void SelectionSort( int [] intArray) 

22 

{ 

23 

int min, temp; 

24 1 

for (int outer = 0; outer < intArray.Length-1; outer++) 

25 

{ 

26 

min = outer; 

27 

for (int inner = outer + 1; inner < intArray.Length; inner++) 

28 

if (intArray[inner] < intArray[min]) 

29 

min = inner; 

30 

temp = intArray[outer]; 

31 

intArray[outer] = intArray[min]; 

32 

intArray[min] = temp; 

33 

} 

34 

} 

35 E 

static void DisplayIntArray(int[] intArray) 

37 

for (int i = 0; i < intArray.Length; i++) 

38 

{ 

39 

Console. WriteLine("Eleroent {0} is {1}”, i, intArray[i]); 

41 

j 

} 

42 

> 

43 

[> 




96 15 66 90 35 94 71 61 34 14 


Insertion sort 

• starting at the second 
element in the array: 

• Save a copy of the element 

• Move the preceding 
elements one position 
down until finding the 
correct position for the 
saved element 

• Put the saved element in 
the correct position 
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14 15 34 35 61 66 71 90 94 96 






Insertion Sort 


• The outer loop moves from the 
second element in the array to 
the last element: The element at 
the outer loop index is saved 

• The inner loop moves from the 
outer loop element of the array to 
the second element, looking for 
the element greater than or equal 
to the element currently being 
pointed at by the outer loop 

• After each iteration of the inner 
loop, the most minimum value in 
the reset of the array is assigned 
to its proper place in the array 

• Is it descending or ascending 
order? How to change that? 


2 using System; 

3 Bnamespace BasicSorting 

4 { 

5|B class Example4 

6 . { 

7|B static void Main() 

8 { 

int[] nums = new int[10]; 

Random rnd = new RandomQ; 

11 for (int i = 0; i < 10; i++) 

nums[i] = rnd.Next(100); 

13 Console. WriteLine(”The unsorrted array: ”); 

DisplaylntArray(nums); 

Console. WriteLine("The sorted array using insertion s)srt: ”) 
16 1 InsertionSort(nums); 

DisplaylntArray(nums); 

Console. WriteLine(”Press any key to continue:”); 

19 Console. Read(); 

20 [ } 

static void InsertionSort(int[] intArray) 

22 { 

23 int inner, temp; 

for (int outer = 1; outer < intArray.Length; outer++) 

25 { 

26 temp = intArray[outer]; 

27 inner = outer; 

while (inner > 0 && intArray[inner - 1] >= temp) 

29 { 

intArray[inner] = intArray[inner - 1]; 

31 inner -= 1; 

32 } 
intArray[inner] = temp; 

34 } 

35 [ } 

static void DisplayIntArray(int[] intArray) 

37 { 

for (int i = 0; i < intArray.Length; i++) 

39 { 

Console. WriteLine(”Element {0} is {1}”, i, intArray[i]); 

41 } 

42 . } 





Report Discussion 


Last lecture report: .NET List(of T) 
methods and properties 


New report: Time comparison between 
the three basic sorting algorithms on 
different array sizes 





Big-0 analysis 





Definition of big-0 

fix) is 0(g(x)) or fix) e 0(g(x)) 

If there is exist C and x 0 > 0 such that /(x) < Cg(x ) for all x > x 0 







Big-0 Example 


Tin) 


5 

+ 2 n ‘ 


By try and error plus intuition (function graphs can be 
helpful) we can find a constant C=7 and n 0 = 1 so that we 
have Cgiri) — In 2 
3 0 5 

Tin) = -n 2 + — n — 3 < Cgin), for all n > 1 
3 5 

Tin) = -n 2 + - n — 3 < 7n 2 , /or all n > 1 
so 7(n) is Oin 2 ) 


Note that many other constants can go, but the value of the constant is not 
important for large n (asymptotic analysis) so any constant that satisfies the 
condition can go. Also note that we could say Cg(n)= 7n 3 instead of saying Cg(n)= 
7n 3 but 7n 2 is the simple function form that satisfies the condition and gives the 
least difference 7(n) and g(n). As the asymptotic function gives small differences 
from the evaluated function as it expresses more the asymptote. 





Big-0 rules 1 




















Big-0 rules 2 


Theorem 5: Each of the following functions is big-0 of its successors: 

K [constant] 

smaller 

log b (n) [always log base 2 if no base is shown] a 
n 

nlogb(n) 

n 2 

n to higher powers 
2 n 
3“ 

larger constants to the n-th power 
n! [n factorial] 
n n 

/ ( n ) = 3 n log(w) is 0(n log(w)) and 0(n 2 ) and 0(2 n ) 









Big-0 rules 3 












Big-0 of the three basic sorting algorithms 


Bubble sort 

The worst statement is the comparison statement. It executes /(n) = (n — 1)(1 + 2 + —I- (n 

— 1) — (tl — 1) + 2 (tl — 1) + ••• + (tl — l )( 7 t — 1) = k + octl + 

F(ri) is 0(n 2 ) Bubble sort is 0(n 2 ) 

Selection sort 

The worst statement is the comparison statement. It executes /(n) = (n)((n — 1) + (n — 2) + •■• 
+ —1-1 = k + an + yn 2 
F(n)isO(n 2 ) Selection sort is 0(n 2 ) 

Insertion sort 

The worst statement is the comparison statement. In the worst cases, it executes f(n ) = (n 

- 1)(1 + 2 H-f (n - 1) = (n - 1) + 2 (n - 1) H-h (n — 1 )(n - 1) = k + an + yn 2 

F(n)isO(n 2 ) Insertion sort is 0(n 2 ) 

Also the three algorithms gives the same big-0 asymptotically, the insertion sort is the worst one 
because the worst operation is likely to execute much in this algorithm. However, asymptotically, 
they have all the same complexity. 





